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Abstract. In these notes we study synchronizability of dynamical pro- 
cesses denned on complex networks as well as its interplay with network 
topology. Building from a recent work by Barahona and Pecora [Phys. 
Rev. Lett. 89, 054101 (2002)], we use a simulated annealing algorithm to 
construct optimally-synchronizable networks. The resulting structures, 
known as entangled networks, are characterized by an extremely homo- 
geneous and interwoven topology: degree, distance, and betweenness dis- 
tributions are all very narrow, with short average distances, large loops, 
and small modularity. Entangled networks exhibit an excellent (almost 
optimal) performance with respect to other flow or connectivity proper- 
ties such as robustness, random walk minimal first-passage times, and 
good searchability. All this converts entangled networks in a powerful 
concept with optimal properties in many respects. 



1 Introduction 

It is broadly recognized that most complex systems in Nature are organized as 
intricated network patterns [1,2]. This observation has triggered an intense re- 
search effort aimed at understanding the organizing principles of these networks, 
their structural properties, and the interplay between topology and dynamics [1, 
2] . It was recently recognized that the classical models of random networks de- 
veloped in graph theory were unable to describe the random but structured, 
hierarchical network patterns found in Nature. Since then, a number of paradig- 
matic models (as small- world and scale- free nets [2]) have seen the light. They 
mimic some of the striking properties observed in real complex networks. In 
any case, network structures play an important role in many contexts ranging 
from brain neural circuits, cellular function webs, ecosystems, social networks, 
food webs, etc., to power grids, Internet or the world wide web. While most of 
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the initial effort was put into understanding the topological properties of net- 
works, the interest has gradually shifted towards the analysis of the interplay 
between topology and the dynamics of network components. In general, each 
element (node) in a network undergoes a dynamical process while coupled to 
other nodes. The system collective behavior depends strongly on the efficiency 
of communication paths, which is in turn dictated by the underlying network 
topology. In this way, the network structure determines to a large extent the 
possibility of a coherent response. 

Complete synchronization is the most prominent example of coherent be- 
havior, and is a key phenomenon in systems of coupled oscillators as those 
characterizing most biological networks or physiological functions [3]. For in- 
stance, synchronized neural firing has been suggested as specially relevant for 
neural signal transmission [4] . From a more technological point of view, precision 
synchronization of computer clocks in local area networks and the Internet is es- 
sential for optimal network performance. Moreover, in an interesting twist, the 
dynamics toward synchronization has been recently used as a dynamical process 
unveiling the underlying community structure in complex networks [5] . 

Here we study how synchronous behavior is affected by the network structure. 
The range of stability of a synchronized state is a measure of the system ability 
to yield a coherent response and to distribute information efficiently among its 
elements, while a loss of stability fosters pattern formation [6]. Here we answer 
the following question: which is the topology that maximizes the network synchro- 
nizability? [7]. We will construct such optimal topologies, for any fixed number 
of nodes and links, by employing an optimization procedure. The resulting struc- 
tures, that we call entangled networks, are optimal not only for synchronizability, 
but also regarding other flow or connectivity properties. 

The paper is structured as follows. In section 2 we summarize the spectral 
approach to synchronization, following Ref. [6]. In section 3 we introduce the 
optimization procedure to obtain networks with optimal synchronizability. Sec- 
tion 4 discusses the relation between the emerging structures and other optimal 
network designs in the literature. Finally, conclusions and further developments 
are presented. A shorter presentation of this work has been published before [7] . 

2 Spectral Approach to Synchronization in Networks 

Consider N identical oscillators at the nodes of an undirected and unweighted 
graph. The state of an oscillator is represented in general by a vector Xj, i g 
[1,-/V], where N is the number of nodes. The network is characterized by its 
Laplacian matrix L, with elements La = fcj (the degree of node i), = — 1 if 
nodes i and j are connected, and = otherwise. L is therefore a symmetric 
matrix with zero-sum rows and real, non-negative spectrum. The dynamics of 
the i-th node can then be represented in a very general form as, 
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Here F(x) and H(x) are unspecified evolution and coupling functions, respec- 
tively. In particular, F(x) controls the dynamics of the uncoupled oscillators, 
while H(x) specifics how variables at different nodes couple together. Most dy- 
namical processes studied in the literature regarding synchronization can be 
recasted in forms equivalent to eq. (1) (sec [6] for more general couplings). 

In the synchronized state all oscillators behave identically at all times. That 
is, Xi(t) — x s (t) Vi £ where x s (i) is solution of the uncoupled equation 

x s = F(x s ) (x represents the time derivative of x). The N — 1 synchronization 
constraints Xi(t) = x 2 (t) = ... = xjy(t) define a synchronization manifold. 
This manifold is invariant owing to the zero-sum row condition in the Laplacian 
matrix L [6] . We are interested here in the stability of the synchronized state. 
For that, we introduce small perturbations £j such that Xi = x s and expand 
to first order to arrive at: = X^jLi [9F(x s )Sij — o-LijdH(x s )] ■ where <9M 
stands for the Jacobian of a matrix M. Diagonalization of L transforms these 
equations into a set of N independent equations for the normal modes [6, 7]: 

^ = [5F(x s ) - <j\ k dU( X s )] ■ y k , (2) 

where Afc, k e [1, TV], are the eigenvalues of L, — Ai < A 2 < . . . < A at. All the 
resulting equations have the same form y = [9F(x ,s ) — a<9H(x s )] • y for some 
positive constant a. The synchronized state x s will be stable if and only if all the 
perturbations fade away in time. This is equivalent to demanding the maximum 
Lyapunov exponent rj max (a) associated with the normal modes orthogonal to 
the synchronization manifold to be negative. The function rj max {a) has been 
called the master stability function in literature [6] , and its dependence on a has 
an universal "V-shapc" for most oscillating systems. In particular, r) max (a) is 
negative only in an interval a a < a < as- The synchronized state will be stable 
if all the non-trivial eigenvalues of L, {A^ : k — 2, . . . , N}, lie within the interval 
[dyi/a, as/cr]. The following inequality then guarantees that there always exists 
a coupling strength a for which the synchronized state is stable, 

Q^<^ . (3) 

A 2 OLA 

It is important to notice that the left hand side in the above inequality depends 
exclusively on the network topology, while the right hand side depends only on 
the dynamics (through x s , F and H). The a range for which the synchronized 
state is stable, a e [^, ^j^], is larger for smaller eigenratios Q. In this way, 
networks with very small Q will exhibit very good (robust) synchronization prop- 
erties for a generic dynamics. The aim of this paper is to find and characterize 
network topologies minimizing the cigenratio Q. 



3 Optimizing Synchronizability: Entangled Networks 



Most studies up to now have explored the value of the eigenratio Q for different 
pre-existing network topologies found in literature, as for instance small-world 
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or scale-free networks, trying to identify key topological features affecting Q. In 
this way, it has been reported that small-worlds have smaller Q than regular 
or purely random graphs [6], and this has been attributed to a smaller average 
distance between nodes in small-worlds. However, other works [8] have concluded 
recently that Q decreases as some heterogeneity measures decrease, even if the 
average distance between nodes increases in the process. On the other hand, 
synchronizability is enhanced in weighted complex networks [9] . 

In this paper we undertake a constructive approach to determine the network 
topology that optimizes synchronization. In order to do so, we devise a modified 
simulated annealing algorithm [10] to numerically minimize Q. We start from 
graphs with TV nodes and a fixed average degree (k). At each step, a new graph 
is obtained by the random deletion of m links and addition of m new ones, where 
m is extracted from an exponentially decaying distribution [7]. The new graph 
is rejected if the resulting network is disconnected; otherwise, it is accepted with 
probability p = min(l, [1 - (1 - q)5Q /T] 1 ^ 1- ^), where SQ = Qf ina i - Q in itiai 
is the eigenratio change in the rewiring, and T is a temperature-like parameter. 
For q — > 1 we recover the standard Metropolis algorithm with Hamiltonian Q, 
while q = — 3 turns out to be the most efficient value (results do not depend on 
the choice of the deformation parameter q, but convergence times do [10]). The 
first TV rewirings are performed at T — oo, and they are used to calculate a new 
T such that the largest 5Q among the first TV ones would be accepted with a 
large probability. T is kept fixed for 100TV rewiring attempts or 10TV accepted 
ones, whichever occurs first. Then T is decreased by 10% and the process is 
repeated until there are no more changes during five successive temperature 
steps, assuming in this case that the optimal network topology has been found. 
Most of these details can be modified without affecting the final outcome. The 
major drawback in the algorithm is that Q is a global observable slow to compute. 
For small enough TV (< 30), the emerging optimal topology found is unique, while 
for larger TV (we have optimized networks with TV up to 2000) the output may 
change slightly from run to run, meaning that the eigenratio absolute minimum 
is not always reached due to the presence of metastable states. Nevertheless, the 
final values of Q are very similar for different runs (see Fig. 1), meaning that a 
reasonably good approximation to the optimal topology is always found [7] . 

We measure different topological observables during the minimization pro- 
cess to unveil the main traits of the emerging structures. In simple terms, we 
observe that as Q decreases the network becomes more and more homogeneous. 
This means that the standard deviation of distributions of most topological ob- 
servables decreases as Q decreases. This is true in particular for the node degree 
distribution, sec Fig. 2. a. We have used this degree homogeneity to improve the 
efficiency our optimization procedure by initializing the algorithm with regular 
networks (i.e. all nodes with the same degree), and restricting the rewiring steps 
to changes that leave the degree of each node unchanged (by randomly select- 
ing pairs of links and exchanging their endpoints; see Fig. 2.b). The resulting 
algorithm converges much faster to the optimal network, and yields lower final 
eigenratios Q when the original one get trapped in a metastable state (Fig 2.c). 
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Fig. 1. Evolution of the eigenratio Q during the optimization procedure for different 
initial conditions. Here TV = 50, (k) = 4. In all cases, the algorithm converges to very 
homogeneous networks as the one depicted, with very similar values of Q. 

In Figs. 3.a-b we show the standard deviation of the average node-to-node 
distance and average betweenness, respectively, versus Q during an optimiza- 
tion run started from a random regular graph. Both observables exhibit the 
aforementioned tendency towards homogeneity. Particularly remarkable is the 
narrow betweenness distribution (Fig. 3.b), which is in marked contrast with 
the broad betweenness distributions observed in networks with strong commu- 
nity structure [11]. In addition, the averaged distance and betweenness also tend 
to decrease with Q, though they are less sensitive than their corresponding stan- 
dard deviations, see Figs. 3.c-d. Another key feature of the optimal structures 
is the absence of short loops. This can be characterized by the girth (length of 
the shortest loop) or, better, via the average size of the shortest loop passing 
through each node. This last magnitude is shown in Fig. 3.e, where it is evident 
that the optimal network has very large average shortest loops. In particular, the 
clustering coefficient is zero for the optimal nets since no triangles are present. 

In general, we call the emerging optimal structures entangled networks: all 
sites are very much alike (strong homogeneity) and the links form a very intri- 
cated or interwoven structure (lack of communities, poor modularity, and large 
shortest loops). Every single site is close to any other one (short average dis- 
tances) owing not to the existence of intermediate highly connected hubs (as in 
scale free networks) , but as a result of a very "democratic" or entangled structure 
in which properties such as site-to-site distance, betweenness, and minimum-loop 
size are very homogeneously distributed (see Figs, l.b, 3.a-b). Sharp distribu- 
tions are also typical of random graph, where randomness alone produces a 
statistical homogeneity. However in this much stronger homogeneity is 

produced during the optimization of Q, as Figures 3.a-b show. 

4 Relation to Other Optimal Topologies 

A natural question concerns the relation between entangled networks and other 
optimal architectures found in the literature. For instance, recent work [12] has 



6 L. Donetti, P.I. Hurtado, and M.A. Munoz 




Fig. 2. Left: Q vs standard deviation of the degree distribution for N = 50, (k) — 4 and 
three different initial conditions. Center: sketch of pair rewiring trial. Right: Eigenratio 
Q vs algorithmic steps for both minimization procedures (see text). 
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Fig. 3. Standard deviations of the node distance distribution (a), standard deviation 
of the betweenness distribution (b), average distance (c), average betweenness (d), and 
shortest-loop average length (e) as a function of the eigenratio Q. 



focused on the optimization of network robustness against random and/or in- 
tentional removal of nodes (attacks). For random graphs in the large- N limit, 
it is concluded that the most robust networks are obtained when the degree 
distribution only has a few peaks. In particular, random fc-regular graphs turn 
out to be the global optimal solution against both errors and attacks in the 
robustness-optimization problem [12]. In this case, the error (/ r ) and attack (f a ) 
percolation thresholds coincide, f r = f a = f c (N, k), with f c (N, k) < / c (oo, k) = 
(k — 2)/{k — 1). A natural question now is whether further Q— minimization 
of these random regular graphs has some effect on the network robustness. As 
shown in [7] the minimization of Q improves significantly the network robust- 
ness, confirming that entangled networks are optimal from the robustness point 
of view. This is because entangled topologies include correlations, absent in ran- 
dom networks, which enhance their resilience. In addition, there is also evidence 
that networks with properties similar to those of entangled graphs maximize 
reliability against link removal [7]. 

Different models of traffic flows on complex network have been recently stud- 
ied [13, 14]. In principle highly inhomogeneous scale-free networks perform well 
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when the traffic is low; hubs can provide fast transition times, while they easily 
jam when the traffic increases. With the model of [14] it has been shown that if 
the density of traveling information packets is above a given threshold, the opti- 
mal network topology is a highly homogeneous, isotropic configuration, strongly 
resembling entangled graphs. In a similar way, it has been recently reported 
[15] that the interplay between network growth processes and evolutionary se- 
lection rules gives rise in some cases to very homogeneous structures with large 
minimal-loops that strongly resemble entangled networks (see Fig. 3.c in [15]). 

Also, during our optimization procedure, A at is observed to change very little 
with respect to A2 , and therefore, minimizing Q is equivalent for all practical pur- 
poses to maximizing A2 . This provides another interesting connection with graph 
theory, where it is known that regular graphs with a large A2 (i.e. large spectral 
gap), are good expanders (see [16, 7] for a definition and applications). Expander 
graphs are very important in computer science for various applications (as the 
design of efficient communication networks or construction of error-correcting 
codes) and can be proved to exhibit a rapid decay of random-walk distributions 
towards their stationary state [17]. This converts entangled graphs in (almost) 
optimal for many information flow processes. 

5 Summary and Outlook 

We have introduced the concept of "entangled networks" [7]. These are con- 
structed using an optimization principle by imposing the eigenvalues of the 
Laplacian matrix to have a quotient \n/^2 as small as possible, guaranteeing in 
this way a robust synchronizability and coherent behavior. The emerging topolo- 
gies are extremely homogeneous: all nodes look very much alike (constituting a 
topology radically distinct from scale free networks). Also, the node-to-node av- 
erage distance tends to be small while the average shortest loops are very large, 
and there is no modular (or community) structure. Entangled networks exhibit 
optimal synchronization properties, but they are also optimal or almost-optimal 
for other communication or flow properties: robustness and resilience against er- 
rors and attacks, traffic flow in the presence of congestion, relaxation properties 
of random walks, etc. These connections make of entangled networks a key tool 
in the context of complex networks. 

An interesting issue concerns the existence of entangled networks in Nature. 
Their construction requires a global optimization process which is unlikely to 
occur in natural evolving systems. Presently, we are working on the identifica- 
tion of local evolutionary rules which give rise to locally-optimal synchronizable 
network patterns, or other feasible approximations to entangled networks. 
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